report 



RESUMES 



ED 010 998 

CONCEPT DEVELOPMENT MATERIALS FOR GIFTED ELEMENTARY 
PUPILS— FINAL REPORT OF FIELD TESTING. 

By- sands, THEODORE AND OTHERS 
ILLINOIS state UNIV., NORMAL 



SE 000 638 



EDRS PRICE MF-$0.09 HC-$2.00 50F. 



PUB DATE 



66 



descriptors- ^CONCEPT FORMATION, ^ELEMENTARY SCHOOL SCIENCE, 
♦ABLE STUDENTS, CURRICULUM DEVELOPMENT, GRADE PLACEMENT, 
INDEPENDENT STUDY, READING ABILITY, RESEARCH REPORTS, 
ADVANTAGED PROGRAMS, NORMAL 



AN ANALYSIS OF A FIELD TEST OF CCIE^iCE LEARNING 
MATERIALS FOR ABLE ELEMENTARY STUDENTS IS REPORTED. THE 
LEARNING MATERIALS FIELD TESTED AND EVALUATED WERE UNGRADED 
INDEPENDENT STUDY KITS. THEY lICRE DESIGNED FOR MAXIMUM 
SUITABILITY REGARDLESS OF TEACHER OR SCHOOL CIRCUMSTANCES. 
THE LEARNING MATERIALS INVOLVED CONCEPT FORMATICN IN THE 
TOPICS OF ATOMS, MOLECULES, AND MEASUREMENT. TWO HUNDRED 
FIFTY-NINE STUDENTS FROM 31 DIFFERENT ILLINOIS SCHOOLS USED 
THE MATERIALS. STUDENTS IN THE STUDY WERE SELECTED BY THEIR 
teachers and administrators. METHODS OF USING THE MATERIALS 
WERE ESTABLISHED BY THE TEACHERS. PRE-TESTS AND POST-TESTS 
WERE ADMINISTERED TO THE STUDENTS. RESULTS ARE REPORTED FOR 
EACH TEST ITEM AND EACH GRADE LEVEL. THE AUTHORS CONCLUDED 
THE LEARNING MATEl lALS TESTED CAN BE USED EFFECTIVELY. 
greater success in use is predicted for grades 2 AND 3 THAN 
FOR GRADES 1 AND 4. (RS) 



JAN 1 7 1967 



Preface 

Thi:» report deals with the final stage of a project In which 
concept development materials for gifted elementary pupils wer5**' 
developed and tested. The materials were originally developed by 
the Elementary Curriculum Materials Project personnel In 1963-65. 
Personnel who helped develop these materials are listed on the next 
page. During the Initial phase the emphasis was on translation of 
a rationale for Instruction Into concrete procedures and materials 
which could be subjected to empirical test. In the final phase the 
emphasis was on refinement of the original products. 

wish to express our appreciation to the many people In the 
public schools and the University who helped us collect and evalu- 
ate the data which are presented In this report. Special mention 
should be made of Mr, Richard Youngs, associate director, who ably 
carried on the day to day administration of our work, and Mr, Robert 
Rumery, evaluation specialist, who was responsible for evaluation 
strategy and analysis of data. Mr, Fred H, Bradshaw and Mr, John H, 
Coni In maintained liaison between participating teachers and project 
personnel. Their sensitivity to the needs of classroom teachers did 
much to facilitate our work. Mrs. Leda Fahronkrog, Mrs. Marge 
Anderson, Sharon Matthews, Connie Mathews, Ruth Johnson, and Kara 
Knight gave able assistance in the collection of dat?i and the pro- 
duction of teaching materials. 
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CHAPTER I 

STATEMENT OF THE PROBLEM 

Teaching the gifted can be a rewarding and, occasionally, an 
exhilarating experience. There are also moments of soul-racking frus- 
tration and gnawing feelings of Inadequacy. To be sure, these are the 
joys and sorrows of all teaching; but for those who work with the 
gifted, all opportunities seem magnified and all failures seem more 
poignant. In part this situation can be explained by the nature of 
the gifted: by definition their potential is greater, and as a result 

most teachers expect more of both their pupils and themselves. This 
Is a part of the probi )m that we cannot solve. Perhaps, It Is just as 
well, for without high expectations the guest for excellence becomes 
an exercise In mediocrity. 

There are, however, ways to make the efforts of both teachers and 
pupils more productive. Teachers can be supplied with instructional 
materials ttat are appropriate tor the Instruction of the gifted, in 
an earl ler report. The Deve I opment and Test I nq of I nstruct i ona I 
rials for Gifte d Primary Pupils , 1965, Theodore Sands, Charles Hicklln, 
Richcid Youngs, Robert Rumery, Barbara Price, and Kenneth Retzer, we 
said that 

Regardless of the type of program, the Inst.uctor must face 
the Ineluctable question of what to teach, and one of the 
prime factors In determining this Is the availability of ap- 
propriate Instructional materials. Whether one operates with- 
in the context of enrichment or acceleration, homogeneous cr 
heterogeneous grouping. In the end all programs must solve the 
problem of obtaining suitable instructional materials. 

Educators have known for some time that young students, especially 

the gifted, can learn principles and skills which employ higher thought 



processes and which have traditionally been taught at an older age. 
However, before more meaningful teaching can take place, If Is neces- 
sary to identify the concept In language appropriate to the grade level 
and to devise experiences .iilch might lead to the development of the 
concept. The Instructional process can be facilitated by providing the 
teacher with materials designed to accomplish these goals. 

Not only Is there need for materials which Induce the use of higher 
thought proces=,es In the learner, but equally Important these materials 
should be adaptable to individualized Instruction. 

The gifted’’ are sometimes identified as a homogeneous group, but 
In reality the range of differences In terms of abilities, skills. In- 
terest. and background is usually very large. No two gifted students 
are “gifted- In the same way. Ideally, the teacher should have avail- 
able Instructional materials which would enable her to vary the cur- 
riculum to meet the needs of the Individual pupil and give each member 
of the class an opportunity to develop his talents am skills at a 
pace and level of learning commensurate with his 

Providing appropriate individual learning exper leisce v 'or gifted 
students pres^^nts problems of a special sort. First, there Is the prob- 
lem of finding materials which are appropriate for the gifted. We would 
argue that at the primary and middle grades, at least, materials used 
by the gifted should develop basic concepts and at the same time require 
the use of higher thought process. Materials designed for use with the 
gifted should Induce In the learner such skills as; analysis, predic- 
tion, verification, extrapolation, and at later stages, synthesis. 

A second major obstacle facing the* teacher Is to find materials 



which will enable her to meet the special needs of gifted students, and 
at the same time leave her sufficient time to meet her obligations to 
her other students. In practice this means thar the teacher must be 
able to assign tasks which do not require her constant supervision and 
free her as the primary source for questions and explanations. 

For teachers of the primary and middle grades this presents an 
almost Insuperable problem If they arc to rely on existing materials. 
There Is the problem of reading. The capacity of the child Is not 
limited by his ability to read, but his learning ability often is. Much 
of the material that explains basic concepts uses the written word as 
the mode of communication. Our previous Investigation (Sands, Hick! In, 
et al., 1965) indicates that many of the concepts in science and mathe- 
matics which are currently reserved for the later grades, can be learneu 
by gifted pupils when a ’-non-reading" means of communication Is used. 

For those gifted pupils who can read, much of current me<-erials Is of 
limited utMlty. At one extreme, the conceptual demards of materials 
are beyond the prior experiences and learnings of primary pupils. At 
the other extreme, language and concepts are understandable, but the 
content is trivial. 

In the previous phase of this project an attempt was made to de- 
vise a strategy for creating materials that would satisfy these defi- 
ciencies. Specific objectives of the first phase of the project were: 

1. To create and test a sequence of Instructional experiences 
which would enable a gifted student while working Indepen- 
dently to develop concepts which were considered basic to 
a discipline, but not usually encountered In the early 



elementary grades. 
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2 , To develop these concepts in a way which would require 
the bringing Into play of higher thought processes. 

3. To identify a strategy of Instruction which would enable 
such materials to be used In the public schools with a rHni~ 
mum of teacher attention and participation, require no 
special training of the teacher, and be adaptable to what- 
ever patterns of administrative arrangements for Instruction 
of th9 gifted are current. 

The results of the first phase are reported In the Final Report 
(Sands, HIcklln, et al., 1965). The results were si-ff Iclently encour- 
aging to further field test the materials developed by the project staff. 

The phase of the project which this report deals with had as its 
objectives the revision of the materials and the evaluation of their 
effectiveness In a variety of school settings. 

Specific objectives were as follows: 

1. To make the revised Instructional material available to all 
the elementary schools in Illinois. 

2. To enable schools to determine whether they wish to make 
such materials a permanent part of their programs for the 
gifted. 

3. To further test the materials to determine: 

c The effectiveness of Improved format of tests, .. 

revision of lesrons, and use of phonographs In- 
stead of tape recorders. 

b. The effectiveness of tne materials with different 
gifted populations. 

c. Teacher acceptance on a state-wide basis, 

o 
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CHAPTER ti 



DESCRIPTION OF MATERIALS 

In the summer and fall of 1964, forty-four self-lnst'uctlonal 
lessons deallnQ with some fundamental concepts about the structure of 
atoms, the nature of molecules, and measurement were written. These 
U'^sons, organized In throe sets or kits of materials, were used by 
one hundred ten pupils In twenty-one first grade classrooms located In 
sixteen different elementary school attendance centers In Bloomington, 
Illinois and McLean County Community Unit District # 5 schools. In the 
summer of 1965 all lessons were reviewed and revised. 

The materials had been written under the following guidelines: 

1. Sensory-motor activities . Wherever possible, abstractions 
and symbols were to be associated with appropriate sensory- 
motor activities. Each lesson should actively engage 

the student In manipulation of illustrative materials and 
overt behavior related to making Inferences, solving 
problems, or predicting. 

2. Operational definitions. The student should be given 
the opportunity to perform an operation and then be told 
the word or words which denote the behavior. 

3. Programming prlnclplos . The Instructional material should 

embody the following techniques derived from programming 
principles: Identification and stutement of objectives In 

terms of behavioral outcomes, presentation of Information 
in small stops, careful sequencing. Immediate confirmation 
of adequate responses, self -pacing. \ 
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The materials provide a depth of treatment and call tor a level 

of abstraction that goes considerably beyond what Is asked of primary 

pupils In science Instruction. The following description from the 

i?65 Final Report might serve as a helpful illustration; 

In the lessons that deal with atomic theory and molecular 
structure, the pupil Is required to develop a mental con- 
struct of the atom and tho molecule by means of symbols. 

The relationships between the symbol and the thing It repre- 
sents are established by analogy. Once the characteristics 
of the parts are Identified, the child Is required to es- 
tablish the relationship between the parts which form the 
atom and the molecule. In addition the child Is asked to 
apply theory to explain or predict change. 

In the measurement unit measurement Is treated as a concept 
as well as an operation. The child Is given the opportunity 
to Identify the elements which are common to all measurement 
and to apply the concept of measurement to a variety of mea- 
suring operations. 

These concepts are presented In a way which makes learning largely 
sel f- Instruct 'onal , but the material can be easily adapted to a variety 
of other teaching strategies. Self- Instruct Ion Is carried on by means 
of plastic phonograph records. In addition each child Is supplied with 
a complete set of specially designed materials and a test booklet. The 
materials provide the child with experiences of an Illustrative or 
problem-solving nature. 

It would be useful to ask, what concepts are developed In the 
units? What higher thought processes are brought Into play? These 
questions can be answered by the following analysis from the 1965 
Final Report; 
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ATOMS 



Co ncept 

The smallest part a whole can 
norma My be d I v I ded I nto I s an 
atom. 



Observations can be made In 
many ways. 



The center of an atom is a place 
called the nucleus. 



An electron moves around the 
nucleus of an atom. 



Objects with the same charge 
repel . 



Attraction and Repulsion. 



Electrons are held In their 
orbits by the attraction of 
unlike charges. 



Activities Involving 
Higher Thought Processes 

Tho child takes a whole apart, se- 
lects a part, which Is then treated 
as a whole and taken apart. After 
this process Is again repeated, the 
child Is asked If the smallest part 
he sees might be broken down Into 
ar* even smaller part. 

Child Is asked to identify the way 
in which two lessons which teach 
a similar concept are alike. 

Child Is given three samples of un- 
known liquids and asked to identify 
the liquids by a variety of obser- 
vational techniques. 

The child Is given an example of an 
atom which Is constructed Incorrect- 
ly, asked to Identify the error and 
to correct It. 

Child Is shown a picture of the Bohr 
atom model and asked how the model 
might be Improved so It would more 
closely resemble a real atom. 

Child Is shown pictures of charged 
atomic particles and asked how the 
particles will behave towards one 
another. 

Child Is asked to compare the ways 
In which magnets and atomic parti- 
cles are slml lar. 

Child Is shown a model of an atom, 
which on spinning throws Its elec- 
trons to the outer limit of the atom 
model. Electrons of the model are 
maintained at this limit by wires. 
The child Is asked what the wires 
stand for In the real atoms (the 
attractive force between the posi- 
tive nucleus and the negative elec- 
tron . > 
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Al 1 atoms are made from the 
same kind of parts. 


Child Is given a variety of objects 
which represent atom parts (electrons, 
protons, neutrons). He Is to arrange 
these parts so as to construct models 
of a number of different atoms. 




The atoms of an element are all 
al 1 ke. 


Child Is provided with pictures which 
represent atoms. He Is to select the 
pictures which represent elements(all 
the same kind of atoms). 




WLECULES 






Concspt 


Activities Involving I 

Hlaher Thouoht Processes ! 




Symbols are used to represent 
things. 


Child Is given several symbols and | 
told to match them with other symbols | 
which stand for the same objects. j 




Atoms Join to form molecules. 


Child Is given two symbols which | 
stand for atoms and asked to join ^ 
these two symbols together. Child Is | 
then asked to name the new entity. j 




Atoms form molecules by sharing 
electrons. 


Child Is provided with a manipulative j 

model of a molecule. The atoms of | 

the molecule model are joined with | 

other atoms of the model with mech- 
anical snap fasteners. The child Is 
then asked what the snap fasteners 
represent, (electrons) 




A collection of molecules com- 
posed of two or more kinds of 
atoms which are uniform In ar- 
rangement Is called a compound . 


The child Is given several groups of 
atoms, some of which are uniform In 
arrangement and composition, and 
others which are varied In their 
arrangement and composition. The 
chIH Is then asked which groups 
represent compounds. 




The properties of a substance 
Identify the substance. 


The child Is given a description of 
the physical characteristics of an 
object and asked to Identify the 
object. 




All samples of Identical compounds 
nave the same kind and arrangement 
of atoms. 


Child Is given pictures which repre- 
sent the atomic structure of a vari- 
ety of substances. He Is to Identify 
which substances have Identical pro- 
perties. 
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Atoms can be arranged In a variety 
of ways to form different molecules* 



The combination or separation of 
atoms and molecules may result In 
the release of energy. 



An Increase of energy Increases 
the motion of atoms and molecules. 



Child manipulates symbols for atoms 
to form molecules. (The symbolic 
manipulation Is followed by a chemi- 
cal experiment which confirms their 
symbolic manipulations.) 

Child Is provided with mechanical 
models which release energy when 
they are separated. Child Is asked 
to Indicate the similarity between 
the mechanical models and chemical 
reactions. 

Child Is asked to explain evaporation 
using this concept. 



MEASUREMENT 



Concept 

The amount of space an object 
occupies Is called Its volume. 



The amount of space an object takes 
up Is Independent of Its orienta** 
tion. 

An object displaces a volume of 
liquid equal to its own volume. 



Activities Involving 
Higher Thought Processes 

Child Is shown pictures of solids, 
liquids, and gases and asked to de- 
termine If the concept of volume 
applies to them. 

Child Is asked to determine why water 
from one container will not fill 
another container of exactly the same 
size which contains some marbles. 

Child is asked to determine volume 
of air In a sealed bottle which has 
water, air, and marbles In It and 
compare the volume of air with that 
of the water and marbles. 

Child is asked to determine if the 
volume of a set of blocks In a given 
position changes as the position of 
the blocks is changed. 

Child makes a measuring cup using a 
given cube as a standard. Uses cup 
to discover that differently shaped 
solids can have the same volume. 

Uses cup to measure volume of an 
I rregu lar I y shaped object • 
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A unit of measure can be any con- 
venient and appropriate object. 



Ar^a and shape are separate. 



The most Important characteristic 
of a standard unit Is Its constancy. 

A standard unit Is a convenience 
and a convention. 

The greater the mass of the nucleus 
of an atom, the greater Is the gra- 
vitational attraction. 

The standard units of measurement 
need to be kept at a constant 
temperature. 



Child Is asked to use three different 
objects as a unit of measure, and 
asked to decide If other objects 
might be used. 

Child Is given four square regions to 
manipulate and asked to determine If 
the different resultant shapes have 
the same area. 

The child Is asked to decide what Is 
most Important about an Inch. 

Child, having measured In various 
sized units. Is asked to evaluate 
their convenience. 

Child Is shown pictures of groups of 
atoms and Is asked to Identify which 
would weigh most. 

Child Is asked to Identify from sev- 
eral alternatives what would happen 
If the standard units were kept at 
varying degrees of temperature. 



CHAPTER III 



USE OF MATERIALS 

One of the objectives of the project was to get data on use of the 
materials from a state-wide sampling of school districts. This objective 
was achieved. 

In the fall of 1965 a brochure announcing the availability of the 
materials was sent school districts throughout the state. The brochure 
explained the nature of the materials and Invited participation In the 
project. To participate, school personnel had to agree to administer 
and return the pre- and post-tests. They also had to agree to return 
the kits at the end of the year. A rental fee of twenty-five dollars 

was levied for each set of three kits. 

Agreements for use of the kits were reached with thirty-one school 
districts and two laboratory schools. Within these districts, 288 sets 
of kits were used in sixty attendance centers. Participating schools 
were chosen to achieve state-wide distribution. 

The thirty-one participating districts encompassed urban and rural 
coiTvnunitles, suburban and Innor-clty schools, culturally deprived and 
culturally advantaged populations. The geographic distribution of 
participating schools Is shown In figure 3.1. 

Who were the users of the materials and how were they chosen? 

Since the question we posed was what results we could expect If these 
materials were put on the markef for general use, minimal restrictions 
were Imposed on manner of use of the materials. Teachers and adminis- 
trators were free to select any pupil who In their judgment was "gifted” 
or who they had reason to believe might benefit from working with the 




11 



FIGURE 3.1 



LOCATION AND NUMBER OF PARTICIPATING PUPILS 



• Polo, 10 



• Round Lake, 1 

Arl^gton Hgts., 1 
‘•Mt.^rosoect, 10 
•Roselfe, 3 
• ElmKurst, 6 
, • Downeys Grove, 1 1 

Aurora, 12 



fe)Ck Island, 20 
Moline, 26 



• Joliet 



•Camp Point, 5 



• Grant Park, 8 



• Lex I ngton ,2 

• Normal, 24 -Clss^a Park, iv 

* Bloomington, 15 



•Lincoln, 25 

• Decatur, 24 
Springfield, 1 

* Pana , 8 



Alton, 10 
Granite City, 11 

* Waterloo, 4 



• SteelevI I le, 12 
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kits. The rationale behind this method of selection of pupils was that 
In the previous phase of the project data had been obtained on how pup- 
ils within a specified range of I.Q. scores performed with the materials. 
The objective this time was to see what would be done with the materials 
by pupils chosen as they would most likely be chosen under normal, non- 
contro 1 1 ed cond 1 1 1 ons . 

Teachers and administrators selected 259 pupils on whom pre-test 
data was returned. These students had an I.Q. range of 86 to 171. We 
have reason to believe that a considerable number of additional pupils 
used the materials. 

Where and how were the materials used? Again no restrictions were 
placed on teachers and administrators. They were free to use the 
materials at any grade level they thought appropriate and In any way 
they found useful. The result was that the materials were used with 
pupils in the kindergarten through the fifth grade. The number of pupils 
In each grade and their location Is g;ven In Table 3.1. 

The heaviest concentration was In •5rade one with thirty-one schools 
using It at this level. Use In grades tv^o, three and four was fairly 
evenly, distributed; eichteen schools usee' the materials In grade two, 
fifteen In grade three, and ten In grade four. Three schools used the 
materials In grade five and one In klndtirgarten. 

A special situation existed In the Washington school, Decatur. This 
school has a well-established program for culturally deprived pupils. The 
staff In Washington school feels that I.Q. tests do not accurately measure 
the Intelligence of their pupils who come frort' cultural ly-daprived envir- 
onments. Using teacher Judgment and performance In class, twenty-four 
pupils were chosen to use the materials. 
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TABLE 3.1 
USE OF MATERIALS 



Location Attendance Centers Grade Pud 1 1 s per Grade 



Alton 


Gilson Brown (Godfrey) 


2 


10 


Ar 1 1 ngton Heights 


Windsor 


2 


1 


Aurora 


Frank HI 1 1 


1 


1 


* 


Freeman 


1 


3 




Greenman 


1 


1 




McC leery 


1 


2 




Nancy Hill 


1 


1 

A 




Smith 


1 


2 




Mary A. Todd 


1 


2 


Bloomington 


Centennial 


1 


5 




Lincoln 


1 


1 




Oakland 


1 


3 




Irving 


1 


2 




Washington 


1 


4 


Camp Point 


Clayton 


4 


1 




Coatsburg 


4 


1 




Golden 


4 


1 




LaPralrle 


4 


1 




Map 1 ewood 


5 


1 


Charleston 


Buzzard Laboratory School 


1 


1 




tf 


2 


1 




n 


3 


2 


CIssna Park 


Unit 6 


1 


1 


Decatur 


Washington 


1 


3 




M 


2 


3 




ft 


3 


4 




M 


4 


10 




t 


5 


4 


Downers Grove 


Fairmont 


2 


3 




Kingsley 


1 


2 




Lester 


3 


3 




Wash 1 ngton 


1 


3 


Elmhurst 


Conrad Fisher 


3 


1 




If 


4 


2 




Corn 1 1 1 e 


2 


1 




fl 


3 


1 




It 


5 


1 


Granite City 


Frohardt 


1 


2 




Logan 


2 


2 




Maryvl 1 le 


2 


2 




Mitchell 


1 


2 




Wl Ison 


3 


2 




(Special ) 


K 


1 
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TABLE 3.1 continued 

Location Attendance Centers Grade 



Grant Park Grant Park Elementary 2 

3 

Joliet Forest Park 4 

Lexington Lexington Elementary 1 

Lincoln Jefferson 1 

2 

” 3 

4 

Northwest 1 

' 2 

i; 3 

Moline Will lard 2 

’’ 3 

Mt. Prospect Lincoln 1 

" 2 

3 

Lion’s Park 2 

Norma I Hudson 1 

’■ 2 

Fa I rv I ew 1 

Oakdale 3 

Metcalf Laboratory School 1 

Pana Lowe! I 4 

Polo Centennial 1 

Robinson Lincoln 1 

Rock Island Eugene Fields 2 

II T 

Roselle Campanelli 3 

HI 1 1 crest 1 

Lakevlew 1 

Round Lake Round Lake Park 2 

Springfield Lindsay 2 

Steeleville Steelevllle Elementary 4 

Waterloo Unit 5 3 



Pup 1 1 s per Gr sde 

4 

4 

3 

2 

3 

3 

2 

5 
2 
2 
8 

9 
17 

3 

3 

3 

1 

4 

4 
8 

5 

3 

8 

10 
2 

10 

10 

1 

1 

1 

1 

1 

12 

4 
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How were the materials used? Data on modes of instruction was obtained 
from forty of the sixty participating schools. Twenty-eight teachers chose 
to use the materials In their original self-instructional format. In this 
mode of Instruction the child worked Independently with the phonograph, 
records, and kit materials, and received only Incidental and occasional 
assistance from the teacher. Most teachers allowed pupils to work during 
regular class time that otherwise would have been free. One teacher 
scheduled use of the materials during the lunch hour, and one pupil used 
the kits before the school day started. 

The second most commonly used mode was teacher- led small group 
Instruction. Nine schools reported using the materials as a basis for 
small group Instruction. In this mode the records were played to the 
group, the teacher controlling the record player and leading discussion 
or asking questions about the concepts being developed In the lesson. 

Three schools used the materials for large group or class Instruction. 
In one school two sets of kits were used to Instruct twenty-seven pupils 
by using an opaque projector and demonstrating the kit materials rather 
than allowing each child to perform the experiments and Illustrative 
activities. In the other two schools materials were supplied to each 
child, but the entire class worked on them at the same time. 

What was the reaction of teachers, parents and pupils to the mate- 
rials? On the‘toasls of data col I ected through visitation and Informal 
conversations with teachers and administrators, It seems appropriate 
to say that the materials wore well received. A member of the project 
staff visited each school In which the materials were used. Most 
teachers saw the kits as useful teaching aids. At only five of the 
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sixty attendance centers using the materiais was teacher response 
negative. At one schooi the materiais were examined but not used. 

A number of suggestions were made for improving the kits; many were 
concerned with errors in production rather than content deficiencies. 

A frecjuent suggestion was that additional enrichment materiais be 

included. 

The overall favorable response of teachers undoubtedly represents 
some element of the Hawthorne effect, if there are elements in these 
materiais which would elicit a negative reaction among teachers, we 

have not been able to identify them. 

The response among students was favorable. At one end of the 
spectrum we received unsolicited fan mail from students telling us 
how much they enjoyed the materials. The following are representative 
samples— though something of the flavor is lost when the smudges and 

labored lines are eliminated by the typewriter: 

I liked the storys you told. I learned many new things about 
science, i hope i see you in secornd grade. Love. 

Mike D. • • • 

i thought your iessons were very nice. Now I know all about 
science, f liked the storys that you told. We told some 
kindergartens al’ about the science* Love, 

Rl tQ H • • • • 

I love the record. And the stoff we did. Love. 

Richard B 

On the other hand, 41 of 237 pupils who completed the atoms unit, 
failed to complete the molecules unit. Most of this attrition was 
among first grade pupils. However, teachers reported that their pupils 
seemed to be interested and highly motivated by the materials. 

A number of teachers remarked on positive responses from parents 



of children using the kits. 



CHAPTER IV 



EVALUATION 

Introduction 

Evaluation goals for this project were less general but more de- 
tailed than evaluation goals In the previous phase of this project 
(Sands, ot al., 1965). In the earlier phase, evaluation centered on 
three questions. 

First, did the Instructional material ... enhance the learning 
of sclontlflc concepts considered to be fundamental to further 
study of science? Second, were the cognitive objectives 
achieved with minimal Inter-classroom variations? Third, were 
the cognitive objectives achieved with minimal undesirable In- 
cidental effects? 

In the earlier project, substantial weight was given to validity of 
Inferences about the effect of experimental treatments In producing 
gain. Because of the Importance of Inferring causal connections between 
gains and treatments, the earlier study was evaluated within the frame- 
work of a quasi -experimental design— a nvodlfled nonequivalent control 

group design (Campbell and Stanley, 1963). 

In the present study, no causal Inferences were to be made; rath- 
er a causal connection was assumed on the basis of the results of the 
earlier study. As a result. In the present study, no safeguards 
against external Influences on validity of Inferences were applied. 
Evaluation of the present study Involved six questions. First, were 
students better able to make correct responses after Instruction than 
they were before Instruction? Second, Is the Instructional material 
difficult for students to master? Third, Is there any difference In 
the level of difficulty of the three units used? Fourth, do students 
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hsv# prior krrowlodQo of socno of the concepts Included In the Instruction? 
Fifth, are there grade differences In the ability to fnaster the material? 
Sixth, do the materials have sufficient holding power that students 
ecu Id be expected to complete all three units 

Most of the Information releva|j^»**e**tTfese questions was obtained 
by a detailed of a set of revised achievement 

tests. ^JtevfST^s were made on achievement tests used In the previous 
project on the basis of data obtained from test performance and from 
teachers* coiwnents. The nature and extent of these revisions Is dis- 
cussed In the next section. 

Revision of Achievement Tests 

Analysis of data and examination of teachers* comments from the 
previous study Indicated the need for several modifications In the 
achievement tests used for evaluation. Among the difficulties In 
test administration reported by teachers were: (I) Difficulty In 
manipulating tost booklets and Instructions reproduced In separate 
book lets; (2) Difficulty In maintaining student attention throughout 
the testing period; (3) Inability of students to remember accurately 
all the alternatives read to them. In addition, summary statistical 
data Indicated that some Items did not change In difficulty level 
as a result of Instruction, some did not adequately discriminate high 
scorers from low scorers, and some wore outside a desirable range of 
difficulty. 

Three kinds of revision resulted. First, Instructions and response 
paqes were Integrated Into a single booklet; second, the number of alter- 
native responses to each Item was reduced to three with a fourth "don't 
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j third, Items which had Inadequate Indices of 

ficulty range, or were 
judged to be ambiguous were either revised or eliminated. Elimination 
of Items was selective so that the sainpilng proportions of domain 
categories described In the previous report would bo disturbed as 
little as possible. 

The structures of the tests on atoms and molecules are given In 
Tables 4.1 and 4.2 In terms of categories of cognitive or logical 
operations and content. 









TABLE 4.1 

(IMPOSITION OF TEST ON ATOMS 



Models & 



Composition 


Structure 


Symbo 1 s 


Knowledge, specifics 2 


i 

2 


2 


Knowledge, generalization 


2 


2 


Comprehension 2 






Application 2 


4 


4 


TABLE 4.2 


COMPOSITION OF TEST ON MOLECULES 


Models & 


Composition 


Structure 


Symbols 


Designation 2 


2 


2 


Description 2 


2 


2 


Explanation 2 


4 





Conditional Inference 




4 
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The composition of the moaturoment test Is described In terms of 
the properties measured and concept categories In Table 4.3. 



TABLE 4.3 

4 

COMPOSITION OF MEASUREMENT TEST 

Conservation Conventions Application 

Volume ^ 2 

Area 2 2 1 

Length 2 2 1 

Weight 2 3 

Temperature 2 2 



As a result of these revisions, all three tests were shortened; 
the atoms tost from 32 to 22 Items; the molecules tost from 30 Items 
to 22 Items, and the measurement test from 30 Items to 24 Items* This 
shortening Implied a theoretical reduction In reliability, but this 
loss was considered to be more than offset by other gains* The dif- 
ference In observed) reliabilities between the earlier tests and the 
revised tests Is summarized In the next chapter. 
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CHAPTER V 






ANALYSIS OF DATA 

Introduction 

Two kinds of statistical analysis are reported In this chapter: 
analysis of Individual Item responses and analysis of total test scores. 
The analysis of Item responses Identifies those Items for which It can 
be said that ability to respond correctly Increased. Further, It helps 
to Idenfify categories of Items which may be ospoclally difficult or 
not sufficiently challenging; It provides us with Information about the 
feasibility of self-instructional use of the material; and It provides 
us with a means to Identify differences between units. Analysis of total 
test scores provides a means for describing the overall level of per- 
formance and for making comparisons between pupils In different grades. 

Description of Tables 

Summary statistics describing test performance for pooled groups 
before and after treatment are presented In Tables 5.1 and 5.2. These 
statistics Include means, standard deviations, and reliability estimates. 

TABLE 5.1 

SUMMARY STATISTICS (POOLED GROIFS) 



Unit 


Mean 


S.D. 


N 


R(KR-20> 


R'(S-B) 


Atoms Pretest 


9.838 


3.251 


235 


.5937 


.6800 


” Posttest 


15.016 


3.464 


237 


.7061 


.7775 


Molecules Pretest 


8.775 


3.422 


223 


.6242 


.7073 


*• Posttest 


12.530 


3.577 


196 


.6653 


.7452 


Measurement Pretest 


14.701 


3.417 


184 


.6430 


.7267 


” Posttest 


18.263 


3.043 


171 


.6547 


.7033 
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The summary statistics In Table 5.1 do not Include a group of 
culturally disadvantaged children In Decatur. Their performances are 
summarized In Table 5.2. 

TABLE 5.2 

SUMMARY STATISTICS - DECATUR GROUP 



Unit 


Mean 


S. D. 


N 


R(KR«20) 


R'(S-B) 


Atoms Pretest 


10.920 


2.855 


25 


.4428 


.5361 


” Posttest 


12.608 


3.240 


23 


.6315 


.7138 


Molecules Pretest 


8.444 


2.910 


18 


.5283 


.6196 


” Posttest 


8.266 


2.669 


15 


.4232 


.5162 


Measurement Pretest 


12.608 


3.117 


23 


.5493 


.6037 


'* Posttest 


15.652 


3.016 


23 


.5412 


.5960 


In this table. 


differences 


In the 


number of 


test scores 


between 



pre-treatment and post -treatment tssts represent students absent on 
test days. Differences from one unit to the next represent attrition. 
Reliability estimates were computed using Kuder-Richardson Formula 20. 
The corrected reliability estimates are Spearman-Brown corrections to 
compensate for the shortening of the revised tests. The corrected 
reliabilities estimate the reliability of revised tests if they had 
been the same length as the original tests. The differences between 
the corrected rel iabi I ities of the revised tests and the rot labi I itios 
of the tests used on the earlier project (Sands et al. . 1965) are no 
larger than could be accounted for by the decrease In the number of 
alternative responses. 
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The lower test reliabilities observed for the Decatur group are 
undoubtedly due to the limited range of performance Imposed by the 
small size of the group. 

Item performance is sutfimarized In Tables 5.3 through 5.8. Tables 
5.3 through 5.5 describe performances of pooled groups. The Item per- 
formance of the Decatur group Is summarized In Tables 5.6 through 5.8. 
For the pooled groups the statistical significance of gains In the pro- 
portions of pupils responding correctly to Items was evaluated using 
the unit normal curve as »n approximation to the binomial distribution 
curve. Because gain rather than unsigned difference was of Interest, 
the test was one-tailed. For the Decatur group, the sample size was 
too small to use the nonnal curve approximation. In lieu of this 
approximation, a graphic approximation of confidence interval for the 
appropriate sample size Is used. 

Those Items tor which the proportion responding correctly In the 
posttest Is outside the .95 confidence Interval for the proportion 
responding correctly on the first test are marked with an asterisk. 
These Items can be considered as showing significant gains. 

Differences between pupils in different grade levels were evalu- 
ated by the use of analysis of covariance with pretest scores as the 
covarlate. Summaries of analysis of covariance are presented In Tables 
5.9, 5.11, and 5.13. Tables 5.10, 5.12, and 5.14 describe the adjust- 
ments and adjusted gains resulting from covariation between pretest 
and posttest scores. 
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TABLE 5.3 

ITEM GAINS*. ATOMS - POOLED GROUPS 




TABLE 5.4 







ITEM GAINS; MOLECULES 


- POOLED GROUPS 








Proportion Correct Responses 


Gain 


Z(p . p 


) 




Prevest 


Posttest 




r,, 




1. 


.3228 


.7653 


.4425 


14.13 




2. 


.1748 


.2295 


.0547 


2.15 




5. 


.5381 


.7091 


.1710 


5.12 




4. 


.4529 


.5357 


.0828 


2,48 




5. 


.3049 


.3724 


.0675 


2.19 




6. 


.9282 


.9591 


.0309 


1.79 


* 


7. 


.4215 


.6377 


.2162 


6.54 




8. 


.4394 


.6734 


.2340 


7.04 




9. 


.3094 


.4081 


.0987 


3.18 




10. 


.3542 


.5765 


.2223 


6.70 




11. 


.2959 


.5969 


.3010 


9.84 


** 


12. 


.6322 


.8367 


.2045 


6.33 




13. 


.3766 


.7500 


.3734 


11.52 




14. 


.2511 


.4693 


.2182 


8 08 




15. 


.2780 


.4540 


.1760 


5.86 




16. 


.3587 


.4030 


.0443 


1.38 


NS 


17. 


.3991 


.6632 


.2641 


8\05 


«« 


18. 


.3049 


.3112 


.0063 


.20 


NS 


19. 


.3497 


.3877 


.0380 


1.19 


NS 


20. 


.2600 


.4234 


.1634 


5.56 


** 


21. 


.4843 


.6377 


.1534 


4.56 




22. 


.5381 


.7295 


.1914 


5.65 





* Significant at 5 percent level 
Significant at I percent level 
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1 TEM GAINS: MEASUREt4ENT 


~ POOLED GROUPS 








Proportion Correct Responses 


Gain 


Z(P2 - P, 


|) 




Pretest 


Posttest 


1. 


.8532 


.9707 


.1175 


4.342 


** 


2. 


.7119 


.8888 


.1769 


5.108 




3. 


.7717 


.8654 


.0937 


2.919 




4. 


.7173 


.8538 


.1365 


3.963 




5. 


.4782 


.9181 


.4399 


11.515 


** 


6. 


.6739 


.8713 


.1974 


5.506 


** 


7. 


.52)7 


.7602 


.2385 


6.243 




8. 


.3750 


.7368 


.3718 


10.043 




9. 


.3586 


.4093 


.0507 


1.382 


MS 


10. 


.3369 


.5438 


.2069 


5.924 




11. 


.7282 


.7836 


.0104 


.305 


NS 


12. 


.6356 


.8421 


.2063 


5.605 




13. 


.8804 


.9298 


.0494 


1.990 


It 


14. 


.7934 


.8070 


.0136 


.459 


NS 


15. 


.6304 


. 5204 


-.1100 


— 


— 


16. 


.4619 


.6081 


.1462 


3.834 




17. 


.6630 


.8011 


.1381 


:^.820 




18. 


.8967 


.9298 


.0331 


1.422 


NS 


19. 


.5978 


.7017 


.1039 


2.770 




20. 


.8967 


.9473 


.0506 


2.174 


;f 


21. 


.1684 


.6374 


.4670 


16.387 




22. 


.5597 


.8304 


.2707 


7.131 




23. 


.9130 


.9532 


.0402 


1.905 




24. 


.0760 


.1520 


.0760 


3.751 





* Significant at 5 percent level. 
** Significant at I percent level. 
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TABLE 5.6 





ITEM GAINS: ATOMS • 


-DECATUR GROUP 




Proportion Correct Responses 


Gain 


P2 > Pi 


Pretest 


Posttest 






1. .5200 


.7391 


.2391 




2. .6000 


.5652 


-.0348 




3. .8800 


1.0000 


.1200 




4. .6000 


.9130 


.3130 




5. .2800 


.4782 


.1982 




6. .4000 


.5652 


.1652 




7. .3600 


.6956 


.3356 




8. .1600 


.0434 


-.1066 




9. .6400 


,6956 


.0556 




10. .4400 


.3043 


-.1357 




11. .4400 


.6086 


.1686 




12. .6000 


.6956 


.0956 




13. .5600 


.4782 


-.0818 




14. .7600 


.8260 


.0660 




15. .0800 


.3913 


.3113 




16. .3600 


.4782 


.1182 




17, .4400 


.8260 


.3860 


* 


18. .6800 


,6j21 


-.0279 




19. .6800 


.3478 


-.3322. 




20. .4000 


. 3043 


-.0952 




21. .3600 


.2173 


-.1427 




22. .6800 


.7826 


.1026 






* Outside .95 confidence Interval. 
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TABLE 5.7 





ITEM GAINS: MOLECULES 


- DECATUR GROUP 




Proportion Correct Responses 


Gain 


P2 > 


Pretest 


Posttest 






1. .1111 


.4666 


.3555 




2. .1111 


.0666 


-.0445 




3. .8333 


.4000 


-.4333 




4. .5555 


.1333 


-.4222 




5. .2777 


.2666 


-.0111 




6. .3333 


.8000 


-.0333 




7. .5555 


.4666 


-.0889 




8. .5000 


.4666 


-.3334 




9. .2777 


.2000 • 


-.0777 




10. .1111 


.3333 


.2222 




11. .1 666 


.2000 


.0334 




12. .6111 


.6666 


.0555 




13. .3888 


.7333 


.3445 


¥r 


14. .2777 


.3333 


.0555 




15. .444A 


.3333 


-.1111 




16. .1111 


.1333 


.0222 




17. .1666 


.6666 


.5000 




18. .3888 


.3333 


-.0666 




19. .3333 


.1333 


-.2000 




20. .3333 


.2000 


-.1333 




21. .5555 


.4000 


-.1555 




22. .5000 


.5333 


.0333 





* Outside .95 confidence Interval. 
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TABLE 5.8 

ITEM GAINS: MEASUREMENT - DECATUR GROUP 



Proportion Correct Responses 


Gain 


P2 > 


Pretest 


Posttest 






1. .8260 


.7826 


-.0434 




2. .8260 


.8260 


.0000 




3. .4782 


.7391 


.2609 




4. .5652 


.8695 


.3042 




5. .3043 


.7826 


.4783 


If 


6. .6956 


.7826 


.0870 




7. .3043 


.5217 


.2174 


* 


8. .4782 


.5217 


.0435 




9. .1739 


.3478 


.1739 




10, .3478 


.3043 


-.0435 




11. .6086 


,652.1 


,0435 




12. .5217 


.9130 


.3913 


If 


13, .8260 


.9565 


.1305 


If 


14. .6956 


.6521 


-.0435 




15, .4347 


.5217 


.0870 




16. .2173 


.3478 


.1305 


If 


17. . 5652 


.5652 


.0000 




18. .8260 


.8695 


.0435 




19. .5652 


.6086 


.0434 




20. .9130 


.8695 


-.0435 




21. .0434 


.3478 


.3044 


If 


22. .3043 


.6086 


.3043 


If 


23. .8260 


.9565 


.1305 


If 


24. .2608 


.3043 


.0435 





* Outside .95 confidence Interval. 
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Item Results for Pooled Groups 

The increases In proportions of correct responses to Items In the 
test on atoms wore significant at the five percent for 19 of the 

22 Items. The Increases In 17 of the 22 Items were significant at the 
one percent level. For most Itemfe, the value of z was beyond the limit 
of available z-tables which Indicates probabilities less than 10 Two 

of the three Items (Items 8 and 21) which failed to show significant gains 
Involved distinguishing between models and symbols representing atoms. 

The third Item which failed to show significant gain (Item 13) was con- 
cer d with recognition of the fact that scientific knowledge of atomic 
structure rests on indirect evidence. About 76?5 of the pupils answered 
this Item correctly In the pretest and about 73$ In the posttest. The 
failure of this item to show gain reflects slight emphasis given to this 

Idea In instruction. 

The gains In proportions of correct responses to the test on mole- 
cuies were significant at the five percent level for 19 of the 22 items. 
The gains In 17 of the 22 Items were significant at the one percent !evel. 
All three of the Items which did not show significant gains could be con- 
sidered as disjunctive questions; that Is, deficiencies In comprehension 
of any of several concepts could result In falling to pass the item. For 
two of the items (Items 16 and 18) the pupil was expected to know that 
absence of atoms Implies absence of matter and vice versa, that energy Is 
distinct from matter in that sense, and that these Items of Information 
are relevant to the questlofi. For the third (Item 19) the pupil was re- 
quired to know that all molecules are alike and recognize that this Infor- 
mation was relevant. The Item V/as made more difficult by the fact that 
one of the foils was true bur Irrelevant. 

o 
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Gains in proportions of correct responses to the test on measurement 
wen) si 9 nlficant at the five percent levoi for 19 of the 24 Ittws. Gains 
sigr if leant at the one percent level were obtained for 16 items. Three of 
the five items which did not produce significant gains can be considered 
to Involve application of measurement concepts to concrete situation. 

One of the items involves measuremen+ of area (Item 9) and although the 
Item was apparently not unusually difficult, the usage of convention might 
have been confusing, both in the instruction and In the item. Both of the 
other two items (Items 15 and 18) wore sufficiently easy on the pretest 
tha” statistically significant gain was difficult to attain. Two of the 
itens (Items 11 and 14) probably failed to show significant gains partly 
because of their relative ease in the pretest (.7282 and .7934 respect- 
ivsiy) and because they dealt with length as an abstraction. 

I tem Pet formance for Decatur Group 

Although direct comparisons of tha Decatur group with the pooled 
groups is not appropriate, some general observations can be made. Appar- 
ently, for the Decatur group nearly all items on tests for all three 
units were more difficult than they were for the pooled groups— at least 
on the posttest; fewer items showed statistical iy significant gains and 
when such gains did appear, they appeared to be smaller then for the 
pooled groups, in the unit on atoms (Table 5.6), 9 of 22 Items showed 
significant gains in the proportion of pupils making correct responses. 
Furthermore, in the posttest, 14 of 22 items were answered correctly 
bv more than half of pupils in the Decatur group as compared with 20 
In the pooled groups. In the unit on molecules (Table 5.7), only three 
of 22 Items showed significant gains In the proporMo.t of students 
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makinQ correct responses • In the pretost, seven (tews jre answered 
correctly and In the posttest only four. Similar Information Is revealed 
In Table 5.2. The pretest moan for this group Is 8.444; the posttest 
mean 8.266, In the unit on measurement, the performance of the Decatur 
group appears to be more nearly comparable to the performance of the 
pooled groups. Significant gains In proportion of correct responses 
appear In 10 of 24 Items (Table 5.8). In this unit 13 Items were 
correctly answered by more than half the students on the pretest; 19 
on the posttest. 

Again, It should be emphasized that substantial Inferences are not 
possible from these results, largely due to the great difference In 
sample size. Nevertheless, comparisons of the descriptive data are 
highly suggestive of differences between the culturally disadvantaged 

group and the pooled groups. 
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TABLE 5.9 

SUMMARY OF AT^ALYSIS OF CX)VARIANCE: ATOMS 

Source Sums of squared 

deviations 



Degrees of 
freedom 



Group regression coefficients about 
common regression coefficient 



79.923 



Individual scores about group 
regression lines 



1511.277 



Group means (posttest) about regression 
1 1 ne based on means 



282.975 



Difference between regression coeffici- 
ent based on means and common regression 
coefficient between groups 



Individual scores about regression liAes 
with slope b^ 1591.200 



Group means about regression line with 
slope b^ 

I 

Individual scores about regression line 
for total group 



287.371 

1878.571 



F^ = 4.455 P<.01 

= 12.040 P <.01 

Fj = 17.784 P<.01 



3 

197 

2 

1 

200 

3 

203 



TABLE 5.10 



(X)MPARIS0N OF ADJUSTED ^€ANS FOR FOUR GROUPS: ATOMS 



Adjustment Adjusted Posttest Adjusted 

Means Gain . 




1 


8.364 


13.449 


-.206 


II 


10.629 


15.750 


.086 


ill 


10.109 


16.543 


.053 


IV 


11.559 


15.765 


.260 


Comb i ned 


9.757 


15.156 





13.243 


4.879 


15.836 


5.207 


16.596 


6.407 


16.025 


4.466 
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TABLE 5.11 



SUMMARY OF ANALYSIS OF C0VAP;ANC£: MOLECULES 

Source of squared Degrees of 

dev iS at ions freedom 



Group regression coefficients about 
common regression coefficient 

Individual scores about group 
regression lines 

Group means (posttest) about 
regression line based on means 

Difference between regression coeffici- 
ent based on means and common 
regression coefficient between groups 

Individual scores about regression 
I ines with slope b^ 

Group means about regression line 
with slope bw 

Individual scores about regression 
I Ine for total group 

F^ = .549 

= 6.86 

F, = 9.37 

TABLE 5.12 

COMPARISON OF ADJUSTED MEANS FOR FOUR GROUPS: MOLECULES 



Group 


Observed Means 
Pretest Posttest 


Adjustment 


Adjusted Posttest 
Means 


Adjusted 

Gain 


1 


8.674 


11.442 


.031 


11.411 


2,737 


II 


8.071 


12.125 


-.215 


12.430 


4.359 


ill 


8,780 


14.380 


.074 


14.306 


5.526 


IV 


9.167 


13.000 


.233 


12.767 


3.602 


Combined 8.598 


12.737 









16.714 

1736.008 

188.709 



3 

171 



18.495 

1752.722 



1 

174 



207.204 

1960.426 

NS 

p< .01 
p< .01 



3 

177 



TABLE 5.13 

SUMMARY OF ANALYSIS OF COVARIANCE: MEASUREMENT 



Source 


Sums of squared 
deviations 


Degrees of 
freedom 


Group regression coefficients about 
common regression coefficient 


11.654 


3 


Individual scores about group 
regression lines 


845.532 


154 


Group means (posttest) about 
regression line based on means 


12.139 


2 


Difference between regression coeffici- 
ent based on means and common 
regression coefficient between groups 


29.359 


1 


Individual scores about regression 
lines with slope b^ 


857.186 


157 


Group means about regression line 
with slope by, 


41.498 


3 


Individual scores about regression 
line for total group 


898.664 


160 


Fi = .708 


NS 




= 3.700 


.05> p >.01 




F 5 = 1.112 


NS 





TABLE 5.14 

COMPARISON OF ADJUSTED MEANS FOR FOUR GROUPS: MEASUREMENT 



Group 


Observed Means 
Pretest Posttest 


Adjustment 


Adjusted Post test 
Means 


Adjusted 

Gain 


1 


13.265 


16.824 


CM 

00 

• 

t 


17.646 


3.559 


II 


15.020 


18.163 


.105 


18.058 


3.143 


III 


15.583 


19.438 


.402 


19.000 


3.870 


IV 


15.032 


18.484 


.111 


18.373 


3.452 


Comb 1 ned 


14.821 


18.321 
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Coffl&arlson of Performance by Grades 

Tha analysis of covariance was used to cowpare posttest perfor- 
mances of the several grade levels represented In the pooled groups. 
Analysis provides for comparison of posttest means adjusted for dif- 
ferences between groups on the basis of covariation between pretest 
and posttest scores. The numbers of cases on w. wh the covariance 
analyses are based are smaller than those on which summary statistics 
are based because the analyses require cases for which both pretest 
and posttest scores are available. When attention Is directed to 
these cases, a clear picture of attrition patterns can be observed In 
addition to Information provided about differences In attainment be- 
tween groups. 

The summaries of analysis of covariance for the three units are 
presented In Tables 5.9, 5.11, and 5.13. To determine whether or not 
the differences between means are large enough to be attrlbuteo to 
differences In effectiveness of Instruction rather than to random 
fluctuations In means, the variance of group means about a common re- 
gression line Is compared to the variance of Individual scores about 
group regression lines having the same slope as the common regression 
tine for pooled scores. This ratio Is the familiar F-ratlo of between 
groups variance to within groups variance. This ratio is represented 
by p2 In the three summary taules. For two of the three units, atoms 
and molecules, the probability that obtained variance ratios of the 
observed size would bo obtained by random sampling Is less than .01. 
For the measurement unit, the probability Is less than .05. 



ERIC 



- 38 



It Is a well-known fac. in the measurement of gain that gain scores 
are negatively correlated with pretest scores* The possibility exists 
that posttest scores are also negatively correlated with pretest scores. 
This Is not serious unless there are systematic differences between 
groups In these correlations. Whether this Is the case can be deter- 
mined by comparing the variance of group regression coefficients about 
a common regression coefficient to the variance of Individual scores about 
group regression lines. This variance ratio Is represented In the 
three sumrrary table,* by . Variance ratios represented by were 

non-signlf leant for the units on molecules and measurement. For the 
unit on atoms, the ratio was significant beyond the one percent level. 
Because most of the spurious variance In between groups variance on 

this unit Involved the second grade, F was retained for this group. 

2 

Even with this spurious covariation, a greater proportion of posttest 
variance Is accounted for by treatment effects. 

Another variance ratio Is of Interest even though It has no bearing 
on the validity of the between groups to within groups ratio. This 
ratio Is the ratio of the variance of group means about a regression 
line based on posttest means to the variance of the difference between 
a regression coefficient based on means and o^'e based on variance be- 



tween groups. This ratio determines whether or not the several means 
are linearly related to pretest scores. For the atoms unit the hypo- 
thesis of a linear trend in group moans Is rejected; for the other 
two units It Is retained. 



The analysis of covariance makes It possible to adjust group post- 
test means for group differences In pretest means on the basis of 
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cx>varlatlon between protest and posttest. CoTRparlson of adjusted post- 
tsst means and resultant adjusted gains Is found In Tables 5.10, 5.12, 
and 5.14. From these tables. It can be seen that for the atoms unit, 
the g.»ln was greatest for the third grade, next greatest for second 
grade, next greatest for the first grade and least for the fourth grade. 
The low gain In the fourth grade undoubtedly reflects the rather large 
size of the pretest mean for this group. For the molecules unit, gains 
were In the order third grade, second grade, fourth grade, first grade. 
For tne measurement unit, the order was third grade, first grade, fourth 
grade, second. In this unit. It Is doubtful that the difference In 
gain between adjacem^ classes In the order can be attributed to differ- 
ences In effectiveness of the Instruction. In general. It seems rea- 
sonable to conclude that the materials were most effective for third 

grade pup I Is. 

Although no statistical comparison was made. It appears that there 
was a substantial grade effect In attrition of cases. Table 5.i5 Indi- 
cates the number of students at each grade level who took both pre- 
test and posttest In each grade. Examination of this table suggests 
that most of the attrition occurred In the first grade and that much of 
this attrition was associated with the unit on molecules. Attrition 
data combined with results of the analysis of covariance suggest that 
the materials presented special difficulties for first grade pupils. 
Special difficulties were not apparent In other grades. 



TABLE 5.15 

PUPILS COMPLETING UNITS BY GRADES 
iPuplls taking Protest and Posttest) 



l^jt 

Atoms 

Molecules 

Measurement 



Grade Total 



1 


II 


III 


IV 




69 


56 


46 


34 


205 


43 


56 


50 


30 


179 


34 


49 


48 


31 


162 



CHAPTER VI 



CONCLUSIONS 

The data obtained from a state-wide trial of the curriculum mat- 
erials developed In this project Indicate that these materials can be 
used profitably by primary grade pupils who are considered academically 
superior by their teachers. The data confirm our earlier findings 
(Sands, Hlcklln, et al., 1965) that academically superior pupils In 
the lower grades can learn content which requires use of cognitive 
operations typically encountered at more advanced stages of cognitive 
development. Instruction by means of a self- Instruct Iona I format was 
found not to be a negative factor in teacher acceptance; on the con- 
trary, among teachers who felt themselves to be weak In the content 
area, It seems to have been an Important factor In gaining acceptance 
of the materials. The data suggest that while the materials can be 
used effectively In the first grade, more effective results can be 
obtained In the second and third grades. These materials were appar- 
ently not effective with a culturally disadvantaged group. 

Are the kits effective teaching devices? On the basis of gains 
registered on pre- and posttest scores, we conclude that the materials 
are effective In developing concepts associated with the nature of the 
atom, molecuUr structure, and measurement. In a previous study, sig- 
nificant gains were made by an experimental group as compared to those 
made by a control group. In this study, controls were not used. The 
gains, however, were larger than those made by the experimental group 
of the previous study. This encourages us to believe that the gains 
can be attributed to use of the materials. 
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Were the materials too difficult for students in classes one through 

fi 

four? For the pooled groups the answer appears to bfc no. In all three 
posttests considerably more than half the Items were, answered correctly 
by more than half the students. This generalization does not apply to 

I 

the culturally-disadvantaged group. For the intermediate grades, espec- 
ially grade four, there Is a strong Indication that the measuremeiit 
unit is not surflciently challenging. Pupils in the fourth grade seem to 
have extensive prior knowledge of the material covered in the unit. For 
the first grade, extremely small gains and substantiai selective attri- 
tion suggest that the content of the molecules unit may be at a higher 
level of abstraction than pupils in this grade can assimilate. 

How did pupils in various grades compare in terms of gain in pre- 
and posttest scores? The patterns of gains for the various grades sug- 
gest that the materials are more appropriate for use in the second and 
third grades than in the first or fourth, and probably most appropriate 
for third grade use. However, with the exceptions noted, gains made in 
all grades were sufficiently strong to warrant use of the materials in 

j 

a 1 1 four grades. 

Are there diffe-onces in effectiveness among the three units? 

Gains in the posttest for atoms were greater than those on the molecules 
unit. Pretest scores in the molecules unit were higher than In the 
other two units, resulting in generally smaller gains. Of the three 

4 

units, the molecule unit seems to be the most difficult. 

What Is the holding power of the three units? With the exception 
noted— first grade pupils In the unit on molecules—attritlon during 
the course of the three units was small enough that It could very 
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easily be attributed to extraneous non- instruct Iona I sources. This 
attrition situation suggests that fourth grade, third grade and proba- 
bly second grads students could successfully complete all thro© units 
in a school year. For first grade, the molecule unit would be a defensi- 
ble omission. A suggested strategy would be to begin Instruction with 
the measurerrvsnt unit, following it with the atoms unit. The molecules 
unit could then be started; then terminated if it appeared to be frus- 
trating to pupi is. 

What was teacher and pupil reaction to the kits? The majority 
of teachers and pupils seem to have reacted positively to the materials. 
Sufficient Interest has been shown to warrant marketing these kits for 

continued use. 

The data obtained in this phase of tho project encourage us to 
believe that the kits In their present stage of development might be 
profitably used by academically superior students In the primary grades. 

The production of those Instructional materials has been turned 
over to the Illinois State University Foundation. The Foundation will 
supervise future distribution In the putTIc schools. 
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